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Abstract 

We consider a model in which the third family fermions are subjected to an 
SU(2) interaction different from the first two family fermions. Constrained by 
the Z-pole data, the heavy gauge boson mass is bounded from below to be 
about 1.7 TeV at the 2a level. In this model, the flavor mixing between r 
and \x can be so large that Br(r — » ^P^^ T )/Br(r — > eV^v T ) and Br(r — > Hfifj) 
provide a better constraint than the LEP/SLC data in some region of parameter 
space. Furthermore, flavor-changing neutral currents are unavoidable in the 
quark sector of the model. Significant effects to the B°-B° mixing and the rare 
decays of the K and B mesons, such as — > ir^uV, b — > suV, B s — > t + t~, 
and B s ^ — > /i r T , are expected. 
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1 The Model 



Despite the great success of the Standard Model (SM), it offers no explanation of the 
origin of fermion flavor, or of the existence of three families. The flavor physics of the 
third family is particularly mysterious for the smallness of the mixing angles and the 
huge hierarchy in masses. In this Letter, we consider a model based on the gauge 
symmetry G= SU(3)c x SU(2)i x SU(2)h x U(l)y . The third generation of fermions 
(top quark, t, bottom quark, b, tau lepton, r, and its neutrino, v T ) experiences a new 
gauge interaction, instead of the usual weak interaction advocated by the SM. On the 
contrary, the first and second generations only feel the weak interaction supposedly 
equivalent to the SM case. The new gauge dynamics is attributed to the SU{2) h 
symmetry under which the left-handed fermions of the third generation transform in 
the fundamental representation (doublets), while they remain to be singlets under 
the SU(2)i symmetry. On the other hand, the left-handed fermions of the first and 
second generation transform as doublets under the SU{2)i group and singlets under 
the SU(2) h group. The U(l)y group is the SM hypercharge group. The right-handed 
fermions only transform under the U(1)y group as assigned by the SM. Finally the 
QCD interactions and the color symmetry SU(3)c are the same as that in the SM. 

The spontaneous symmetry-breaking of the group SU(2)i x SU{2) h x U(l)y is 
accomplished by introducing two scalar matrix fields E and $, which are assigned 
as E ~ (2,2)o an d $ ~ (2,l)i. (The scalar doublet $ carries equivalent quantum 
numbers as the SM Higgs doublet.) We assume that the first stage of symmetry 
breaking is accomplished through the E field by acquiring a vacuum expectation 



order as the SM symmetry-breaking scale. Because of this pattern of symmetry 
breaking, the gauge couplings are related to the £7(l) em gauge coupling e by the 
relation 1/e 2 = 1/gf + l/g 2 h + l/g' 2 . We can define 
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where 9 is the usual weak mixing angle and is a new parameter of the model. 

To derive the mass eigenstates and physical masses of the gauge bosons, we need 
to diagonalize their mass matrices. For > gi (equivalently tan0 < 1), we require 
9h < 47T (which implies sin 2 > g 2 /(47r) ~ 1/30) so that the perturbation theory is 
valid. Similarly for g h < g h we require sin 2 < 0.96. For simplicity we focus on the 
region where x(= u 2 /v 2 ) is much larger than 1, and ignore the corrections which are 
suppressed by higher powers of 1/x. To the order 1/x, the light gauge boson masses 
are found to be M^± = Mf cos 2 9 = Mq(1 — sin 4 <p/x) , where M = ev/2 sin 9. While 



for the heavy gauge bosons, one finds 
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sin cos 2 cos 2 J 
Up to this order, the heavy gauge bosons are degenerate in mass because they do not 
mix with the hypercharge gauge boson field. 

The first and second generation fermions acquire their masses through the Yukawa 
interactions to the $ doublet field, while the third generation fermion masses have to 
be generated through higher dimension operators. Given the fermion mass matrices, 
one can derive their physical masses by diagonalizing the mass matrices using bilinear 
unitary transformations. For example, In terms of the fermion mass eigenstates, we 
have the interaction terms: 
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where L u and L d are unitary matrices needed to diagonalize the up and down quark 
matrices, respectively, and 

/0 0\ 

G= . (4) 
\0 l) 

For the charged-current interactions in the quark sector, one observes that in the 
case of ignoring the new physics effect, quark mixing is described by a unitary ma- 



trix V = L' u Ld which is identified as the usual Cabibbo-Kobayashi-Maskawa (CKM) 
mixing matrix. With the inclusion of new physics, the mixing acquires an additional 
contribution proportional to sm 2 (j)/x, with L^GLd = L^LdL^GLd = VL d GLd = 
L\GL U V. Therefore, we would expect the extracted values of the CKM matrix ele- 
ments to be slightly modified due to the new contributions of the model. 

In this model, lepton mixing is an exciting possibility. However, the almost van- 
ishing partial decay widths of //~ — > e~e + e~ and /i~ — > e~7 have severely suppressed 
any possible mixing between the first and second family leptons. Since the lepton 
number violation processes involving the third family are not as well constrained, 
and the mixing strength between leptons may be directly related to their masses, 
we assume in this paper that lepton flavor mixing is only allowed between the sec- 
ond and the third family. The strength of the lepton flavor mixing in this model is 
parametrized by sin/3. The minimal mixing corresponds to (3 = 0, and a maximal 
mixing implies /? = 7r/4. Furthermore, flavor mixing can exist in the neutrino sector 
despited that neutrinos are massless, which may induce an interesting effect to the 
neutrino oscillation phenomena. As to be shown later, quark mixing must be present 
in the model, although lepton mixing is merely a possibility. Hence, flavor-changing 
neutral currents (FCNCs) are unavoidable in the quark sector. In the following, we 
discuss the effect of the new physics predicted by this model to low-energy exper- 
iments, as well as the constraints derived from the present data on the parameter 
space of the model. 

2 Constraints From Z-Pole Data 

Following Ref. M, we calculate the changes in the relevant physical observables rel- 
ative to their SM values to leading order in 1/x. Namely, any observable O can be 
written as O = SM (1 + 50) , where O is the SM prediction including the one- 
loop SM correction, and 50 represents the new physics effect to leading order in 1/x. 
using the most recent LEP and SLC measurements || (including the total width of 
the Z boson Tz, R e , R/j,, Rt, the vector gy e and the axial-vector gA e couplings of 
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Figure 1: The lower bound on the heavy mass Z' as a function of sin 2 (p at the 2a 
level. Solid curve: including all Z-pole data and assuming no lepton mixing. Dashed 
curve: including all Z-pole data and assuming maximal lepton mixing (sin 2 /? = 0.5). 
Dotted curve: only including the hadronic measurements in the fit and assuming no 
lepton mixing. 

the electron, the ratios gv(ji,T)/9Ve, 

hadronic cross section a®, R b , R c , A b , A c , and A C FB ), and the SM predictions of the 
above observables |§, we find that the precision Z-pole data requires the heavy gauge 
boson mass to be larger than about 1.9 TeV at the 2a level, and the parameter x 
to be larger than 20 for (3 = 0. In Figure 1 (solid curve) we show the minimal Z' 
mass as a function of sin 2 (ft at the 2a level, assuming no mixing in the lepton sector. 
The Z-pole observable that imposes the most stringent constraint on the model is 
R T , which is the ratio of the partial decay widths of Z boson into the t + t~ and the 
hadronic modes. The measurement of Y z also plays an important role secondary to 
R T , especially for small sin 2 0, due to the high precision of data. We find that x can 
be as small as 20 for the smallest allowed value of sin 2 (p (= 0.04), and it increases as 
sin 2 cf) increases. Furthermore, the quantity sin 2 (fr/x is constrained by data to be less 
than about 2 x 10~ 3 for a large range of sin 2 0. As also shown in Figure 1 (dotted 
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curve), without including the leptonic observables from the Z-pole data, the bounds 
on Mz> and x is about 900 GeV and 5, respectively. (In this case, the important 
constraint is coming from the measurement of Rb.) 

If a mixing between /i and r is allowed, we also need to include the limit on the 
branching ratio of Z — > fir from LEP/SLC data Q. In Figure 1 (dashed curve), we 
depict the new constraints on sin 2 and Mz> for sin 2 j3 = 0.5. We find that the lower 
limit on the heavy mass is reduced to Mz> ~ 1.7 TeV. The reason for this slightly 
lower bound is due to the reduced non- universal effect in R T . We find that for the 
smallest allowed value of sin 2 = 0.04, the value of x can be as low as 20, which 
is similar to the case of sin 2 (3 = 0. The reason is that for small values of sin 2 
(< 0.2), the measurement Tz, which is independent of the mixing angle sin 2 /5, plays 
the important role in constraining the parameter x. Again, the quantity sin 2 0/x is 
found to be less than about 0.3%. 

3 Constraints From Low-Energy Data 

Even though the Z-pole data already impose significant constraints, this model has 
a rich structure that can be further examined at much lower energy scales. In the 
following sections, we would like to examine those constraints obtained from the low- 
energy hadronic, leptonic, and semi-leptonic data. We will concentrate on the very 
low-energy regime, i.e., physics at zero- momentum transfer, and examine whether the 
parameters of the model can be better constrained than those imposed by LEP and 
SLC data. For clarity, we shall separately discuss below the effects from the lepton 
and quark sectors to lepton number violation phenomena, as well as to kaon and 
bottom physics. 

3.1 The Lepton Sector 

It is easy to see that if the third family lepton does not mix with the first family 
lepton, then the partial decay width of \x — > eee and fi —>■ c-f will not be modified. 
However, if the lepton mixing involves the third family, then the lifetime of the r 
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lepton will be modified. The only modification to the total decay width, to the order 
1/x, is coming from the partial decay width T (r~ — > n~p^i> T ). We find 



where f(m^/ m T ) is a phase factor H given by f(y) — 1 — 8y 2 + % 6 — y 8 — 2Ay 4 ln(y) . 

After comparing with data Q, we find that the above ratio constrains the param- 
eter x > 27 ~ 48. Also the lepton number violation process r — > ////// provides the 
constraint x > 37 consistent with the above measurement. Therefore, the above two 
measurements give a stronger constraint than the Z-pole data for sin 2 < 0.1. On the 
other hand, giving its present experimental limit, the decay process r — > fi'y has not 
yet played a significant role. Nevertheless, if the above discussed decay widths can be 
measured to a better accuracy in future experiments, they can further test the pro- 
posed model. Hereafter, when discussing the predictions of our model to low-energy 
processes, we will consider x > 20 for sin 2 /3 = 0.0, and x > 48 for sin 2 /? = 0.5. 



To completely describe the interactions of gauge bosons and quarks, it requires two 
mixing matrices L u and because both the up- and down-type quarks are massive. 
As noted in Eq. ([3]) that the neutral-current mixing matrices [L\GL U and l) d GL<i) are 
related to the charged-current mixing matrix (jJ u Li). Because of the experimental 
evidence of the CKM matrix in charged currents, FCNCs must occur in this model 
between the interaction of quarks and gauge bosons, and can be realized in three 
different ways: (i) in the down-quark sector only, (ii) in the up-quark sector only, 
and (iii) in both sectors. All these three possibilities have to confront the existing 
low-energy data. In the following, we investigate these three possibilities, separately. 

First, we consider the case that only down- type quarks can mix, so that L^GLu = 
G, and h\GL d = V^GV. This implies that FCNC processes are completely deter- 
mined by the CKM matrix V, in addition to sin 2 and x. Since the matrix elements 
of V^GV are naturally small, we generally do not expect large effects in FCNC pro- 
cesses. Under the assumption that the r lepton does not mix with the electron e, the 




3.2 The Quark Sector 
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decay width of K + — > 7r°e + ^ e is not modified at tree level. However, K + — > n + vT> will 
be modified through the FCNC interaction s — > d Z — > dvv. The expected branching 
ratio, normalized to the predicted branching ratio for K + — > 7r°e + z/ e , can be written 

as 

Br(AT+ -> -K+vV) _JL_ ( \V td \ 2 \Vts\ 2 \ , . 

Bi(K+ -> 7r°e+z/ e ) Ax 2 \ \V US \ 2 J ' U 

For x = 20, we find that Br(K + — > 7r + z/z7) is a few times larger than the SM predic- 
tion. In the above result we summed over all neutrino flavors, therefore, the sin 2 j3 
dependence cancels. Furthermore, since the above observables do not depend on the 
parameter sin 2 (p, they can directly constrain the parameter x of the model. The effect 
to the K°-K° mixing is of the same order as the SM prediction, which can only be 
useful if the long distance contribution can be better understood theoretically. 

This model also predicts non-standard effects for bottom physics. The important 
process to consider is B®-B® mixing where new effect is expected to occur at tree 
level. After substituting all the relevant variables by their numerical values, we find 

(AM Bq ) SM ~ x ' 1 1 

Given the constraint on x (> 20) imposed by the Z-pole data, without lepton flavor 
mixing (i.e., sin 2 /? = 0), the new contribution can be a few times of the SM predic- 
tions. In the case that r and fi mix with the maximal strength (i.e., sin 2 /3 = 0.5 and 
x > 48), the new contribution to B®-B® mixing is expected to be less than 150%. Fur- 
thermore, our model predicts tree-level contribution to the process b — > suu, whose 
branching ratio, when normalized by Br (b — > cfi~T7^), is given as 

Br (fe -> suu) 1 \V t sVtb\ 2 , , 

Br(6-c/z-I£) Ax^V^fiz)' U 

where f(z) = 1 — 8z 2 + 8z 6 — z 8 — 24z 4 ln(z) and z = mc/rrif, 0, 0. The typical size 
of the predicted branching ratio is listed in Table 1. Another interesting process to 
consider is the decay B S ( j — > £ + £~ . At tree level, the decay rate is given by 

r{Bq _ T+n . WW H ,. 4 ,^, r (, _ 



(9) 



Using the values cos 2 /? = 0.5, sin 2 = 0.04, m Bs = 5.369 GeV, and f Ba = 0.23 
GeV [H, we find that the current data on the branching ratios of B s ^ — > t~t + , fi~fi + 
does not impose a better constraint on the model than that by the Z-pole data. 
Since this model also predicts the non-SM decay modes, such as b — > s/i ± r T and 
B s ,d / i±rT ) with comparable branching ratios, they should be measured to test 
the model prediction on the lepton flavor mixing dynamics (i.e., sin 2 /? dependence). 
As a summary to this scenario, in Table 1 we tabulate the predictions of our model 
for various processes in two cases: (i) sin 2 /? = 0.0 and x = 20, (ii) sin 2 /? = 0.5 and 
x = 48. For both cases we set sin 2 = 0.04. 

Under the scenario that only up-type quarks can mix, there will be no non- 
standard effect present in the hadronic decays of K, D and B mesons. This is because 
in the pure hadronic interaction, the new physics effect is only expected in processes 
that AB vanishes, i.e., the number of b quark must be the same in the initial and 
final states of a reaction. It is easy to see that new effects in the charged-current 
semi-leptonic decays are only expected in the 6-quark system. As an example, it can 
modify the decay branching ratio of B® — > D~£ + v and B° s — > D~£ + v to be 



where all the three lepton (including neutrino) flavors are included. (Note that the 
sin 2 /3 dependence cancels.) However, with x > 20, imposed by the Z-pole data, we 
do not expect the new physics effects to exceed 10%. Furthermore, the unitarity 
condition of the CKM matrix will be modified, but its change is extremely small for 
the values of x that agree with Z-pole data. At one-loop level, the K°-K°, B°-B° 
mixing and the decay width of b — > 57 can be modified, but the one-loop effects are 
generally small and do not exceed the level of 0.4% compared with the SM prediction. 
Although FCNC decay of charm meson is expected to be modified at tree level, the 
non-standard effect is again small because of the natural suppression imposed by 
the FCNC couplings (which are the products of CKM matrix elements). The only 
suspected new effect in the 6-quark system is through the T(1S) decay, which proceeds 
through bb —>■ 7, Z, Z' — ► [i + fi~ . We find the expected maximal deviation in the ratio 




(10) 
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r(T(lS) -> T + T-)/T(T(lS) -> is less than ±0.1% for x > 20. It vanishes for 

the maximal lepton mixing scenario, i.e. for sin 2 (5 = 0.5, and the partial decay width 
of T(IS') into the /i ± r :F has to be measured to test this scenario. 

Under the general mixing scenario, the model requires two additional free (real) 
parameters, which can be chosen to be any two of the 31, 32 and 33 elements (i.e., 
(^31)^32 and d.33) of the L d mixing matrix, although additional phases can be introduced 
to generate a new source of CP violation. (Note that the unitarity condition of the 
matrix L d requires | 1 2 -|- 1 cZ 32 1 2 -|- 1 cZ 33 1 2 = 1.) It turns out that depending on the values 
of the parameters, sizable effects in various FCNC processes are expected. In Table 2, 
we summarize the results under this scenario by giving the constraints on the mixing 
parameters, extracted from various experiments. Similar to the discussions given 
for the other two scenarios, the general mixing scenario also allows lepton number 
violation processes, such as B s<d — » / u ± r T and b — ► sjj^T^. Since their branching 
ratios are of the same order as those for the r + r~ mode, they can be very useful for 
further testing the model. 

Finally, we note that in the SM neither L u nor L d can be separately determined, 
and only the CKM matrix V, which is the product of L\ and L d , can be measured 
experimentally. However, in this model, the elements in the third column of the 
L Uyd mixing matrices can be determined, and can be further constrained by including 
the other low-energy data. In conclusion, we have shown that the current low energy 
data (including the Z-pole data) still allows the third family fermions to have different 
gauge interactions from the first and the second family fermions, though the mass of 
the heavy gauge bosons in this case has to be larger than 1.7 TeV. Fortunately, as 
summarized in Tables 1 and 2, many of the predicted new effects of this model can 
be further tested at the Tau/Charm, Kaon and Bottom factories. 
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Table 1: Predictions of various decay rates and mixing in the SM and this model 
under the <i-quark mixing scenario. Case I: sin 2 /3 = 0, x = 20, sin 2 = 0.04. Case 
II: sin 2 = 0.5, x = 48, sin 2 <p = 0.04. 
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0.9729 
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< 8.6 x 10- 7 
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6.1 x 10- 10 


1.7 x 10- 8 
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< 8.3 x 10" 4 








4.0 x 10- 7 
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? 
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4.3 x 10- 8 


2.6 x 10- 6 


1.0 x 10- 7 


Br(5 s - 


-> r+r") 


? 


9.1 x 10- 7 


5.0 x 10" 5 


2.0 x 10- 6 


T(1S) 


^+r+ 


? 








4 x 10- 10 



Table 2: Constraints on the quark mixing parameters under the general mixing sce- 
nario. 



Process 


sin 2 /? 


sin 2 


Constraint 


Br(K+ -> n+uV) 

Br(6 — > svV) 
Bi(b — > s/jL + /j,~) 
Br(B d -> fi+fi-) 
Bi(B s -> fi+fi-) 


independent 
independent 

0.5 

0.5 

0.5 


independent 
independent 

0.04 

0.04 

0.04 


\d 31 d 32 \/x ^1.0 x 10- 4 
\d 32 d 33 \/x £2.9 x 10- 3 
1^32^331/3: £2.3 x 10- 3 
\d 31 d 33 \/x x IO- 3 
\d 32 d 33 \/x &1.2xl0~ 2 
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